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METHODS AND APPARATUSES FOR REPRODUCING AND RECORDING 
STILL PICTURE AND AUDIO DATA AND RECORDING MEDIUM HAVING 
DATA STRUCTURE FOR MANAGING REPRODUCTION OF STILL PICTURE 

AND AUDIO DATA 

FOREIGN PRIORITY 
[0001] The present invention claims priority under 35 U.S.C. 

119 on Korean Application No. 10-2003-011521 filed February 24, 2003; the 
contents of which are incorporated by reference in their entirety. 

BACKGROUND OF THE INVENTION 
Field of the Invention 

[0002] The present invention relates to methods and 

apparatuses for reproducing and recording still picture and audio data, and to 
a recording medium having a data structure for managing reproduction of 
still picture and audio data. 

Description of the Related Art 

[0003] The standardization of new high-density read only and 

rewritable optical disks capable of recording large amounts of high-quality 
video and audio data has been progressing rapidly and new optical disk 
related products are expected to be commercially available in the near future. 
The Blu-ray Disc Rewritable (BD-RE) and Blu-ray Disk ROM (BD-ROM) are 
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examples of these new optical disks. 

[0004] While the standard for BD-RE has been published, the 

standardization for high-density read-only optical disks such as the Blu-ray 
ROM (BD-ROM) is still under way. Consequently, an effective data structure 
for managing reproduction of still pictures recorded on the high-density 
read-only optical disk such as a BD-ROM is not yet available. 

SUMMARY OF THE INVENTION 

[0005] The recording medium according to the present invention 

includes a data structure for managing reproduction of still pictures and 
audio data recorded on the recording medium. 

[0006] In one exemplary embodiment, still picture data and 

audio data reproduced from the recording medium are decoded based on 
respective, independent system times (STCs). For example, a first STC for the 
still picture data is generated based on the still picture data reproduced from 
the recording medium, and a second STC for the audio data is generated 
based on the audio data reproduced from the recording medium. 

[0007] In one exemplary embodiment, the first STC is generated 

from program clock references (PCRs) in the still picture data, and the second 
STC is generated from PCRs in the audio data. 

[0008] In another exemplary embodiment, the still picture data 

and the audio data are decoded based on the first and second STCs, 
respectively, and presentation time stamps (PTSs) in the respective still 
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picture and audio data. 

[0009] The present invention further provides apparatuses and 

methods for recording and reproducing the data structure according to the 
present invention, and recording and reproducing slide shows according to 
the present invention. 

BRIEF DESCRIPTION OF THE DRAWINGS 

[0010] The above features and other advantages of the present 

invention will be more clearly understood from the following detailed 
description taken in conjunction with the accompanying drawings, in which: 

[0011] Fig. 1 illustrates an exemplary embodiment of a 

recording medium file or data structure according to the present invention; 

[0012] Fig. 2 illustrates an example of a recording medium 

having the data structure of Fig. 1 stored thereon; 

[0013] Figs. 3 and 4 illustrate a detailed embodiment of portions 

of the data structure in Fig. 1 and a method for managing still images of a 
high-density recording medium according to the present invention; 

[0014] Fig. 5 illustrates a schematic diagram of a partial 

structure of an optical disc reproducing apparatus according to an 
embodiment of the present invention; 

[0015] Fig. 6 illustrates a detailed structure of a first 

embodiment of an optical disc apparatus according to the present invention; 

[0016] Fig. 7 is a detailed structure of a second embodiment of 
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an optical disc apparatus according to the present invention; and 

[0017] Fig. 8 illustrates another embodiment of a recording and 

reproducing apparatus according to the present invention. 

DESCRIPTION OF THE EMBODIMENTS 

[0018] In order that the invention may be fully understood, 

exemplary embodiments thereof will now be described with reference to the 
accompanying drawings. 

[0019] A high-density recording medium such as a high density 

optical disk, for example, a Blu-Ray ROM (BD-ROM), BD-RE, etc. in 
accordance with the invention may have a file or data structure for managing 
reproduction of video and audio data as shown in Fig. 1 . Some aspects of the 
data structure according to the present invention shown in Fig. 1 are the same 
as the well-known BD-RE standard, as such these aspects will be reviewed, 
but not described in great detail. 

[0020] As shown in Fig. 1, the root directory contains at least 

one BD directory. The BD directory includes general files (not shown), a 
PLAYLIST directory in which playlist files (e.g., *.mpls) are stored, a CLIPINF 
directory in which clip information files (*.clpi) are stored, and a STREAM 
directory in which MPEG2 -formatted A/V stream clip files (*.m2ts), 
corresponding to the clip information files, are stored. 

[0021] The STREAM directory includes MPEG2-formatted A/V 

stream files called clip streams files or just clip files. The A/V stream includes 
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source packets of video and audio data. For example, a source packet of video 
data includes a header and a transport packet. A source packet includes a 
source packet number, which is generally a sequentially assigned number 
that serves as an address for accessing the source packet. Transport packets 
include a packet identifier (PID). The PID identifies the sequence of transport 
packets to which a transport packet belongs. Each transport packet in the 
sequence will have the same PID. 

[0022] The CLIPINF directory includes a clip information file 

associated with each A/V stream file. The clip information file indicates, 
among other things, the type of A/V stream associated therewith, sequence 
information, program information and timing information. The sequence 
information describes the arrival time basis (ATC) and system time basis (STC) 
sequences. For example, the sequence information indicates, among other 
things, the number of sequences, the beginning and ending time information 
for each sequence, the address of the first source packet in each sequence and 
the PID of the transport packets in each sequence. A sequence of source 
packets in which the contents of a program is constant is called a program 
sequence. The program information indicates, among other things, the 
number of program sequences, the starting address for each program 
sequence, and the PID(s) of transport packets in a program sequence. 

[0023] The timing information is referred to as characteristic 

point information (CPI). One form of CPI is the entry point (EP) map. The EP 
map maps a presentation time stamp (e.g., on an arrival time basis (ATC) 
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and/or a system time basis (STQ) to a source packet address (i.e., source 
packet number). The presentation time stamp (PTS) and the source packet 
number (SPN) are related to an entry point in the AV stream; namely, the PTS 
and its related SPN point to an entry point on the AV stream. The packet 
pointed to is often referred to as the entry point packet. 

[0024] The PLAYLIST directory includes one or more playlist 

files. The concept of a playlist has been introduced to promote ease of 
editing/ assembling clips for playback. A playlist file is a collection of playing 
intervals in the clips. Each playing interval is referred to as a playitem. The 
playlist file, among other things, identifies each playitem forming the playlist, 
and each playitem, among other things, is a pair of IN-point and OUT-point 
that point to positions on a time axis of the clip file (e.g., presentation time 
stamps on an ATC or STC basis). The playlist file may also include 
sub-playitems that also provide a pair of IN-point and OUT-point that point to 
positions on a time axis of a clip file. Expressed another way, the playlist file 
identifies playltems and sub-playitems, each playitem or sub-playitem points 
to a clip file or portion thereof and identifies the clip information file 
associated with the clip file. The clip information file is used, among other 
things, to map the playitems to the clip file of source packets. Playlists may 
also include playlist marks which point to specific places (e.g., a specific 
address) in a clip file 

[0025] The general information files (not shown) provide general 

information for managing the reproduction of the A/V streams recorded on 
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the optical disk. 

[0026] In addition to illustrating the data structure of the 

recording medium according to an embodiment of the present invention, Fig. 
1 represents the areas of the recording medium. For example, the general 
information files are recorded in one or more general information areas, the 
playlist directory is recorded in one or more playlist directory areas, each 
playlist in a playlist directory is recorded in one or more playlist areas of the 
recording medium, etc. Fig. 2 illustrates an example of a recording medium 
having the data structure of Fig. 1 stored thereon. As shown, the recording 
medium includes a file system information area, a data base area and an A/V 
stream area. The data base area includes a general information file and 
playlist information area and a clip information area. The general information 
file and playlist information area have the general information files recorded 
in a general information file area thereof, and the PLAYLIST directory and 
playlist files recorded in a playlist information area thereof. The clip 
information area has the CLIPINFO directory and associated clip information 
files recorded therein. The A/V stream area has the A/V streams for the 
various titles recorded therein. 

[0027] Video and audio data are typically organized as 

individual titles; for example, different movies represented by the video and 
audio data are organized as different titles. Furthermore, a title may be 
organized into individual chapters in much the same way a book is often 
organized into chapters. 
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[0028] Because of the large storage capacity of the newer, 

high-density recording media such as BD-ROM and BD-RE optical disks, 
different titles, various versions of a title or portions of a title may be recorded, 
and therefore, reproduced from the recording media. For example, video data 
representing different camera angles may be recorded on the recording 
medium. As another example, versions of title or portions thereof associated 
with different languages may be recorded on the recording medium. As a still 
further example, a director's version and a theatrical version of a title may be 
recorded on the recording medium. Or, an adult version, young adult version 
and young child version (i.e., different parental control versions) of a title or 
portions of a title may be recorded on the recording medium. Each version, 
camera angle, etc. represents a different reproduction path, and the video 
data in these instances is referred to as multiple reproduction path video data. 

[0029] Because of the large storage capacity of the newer, 

high-density recording media such as BD-ROM, still images or pictures may 
be recorded and reproduced in an organized and/or user interactive fashion, 
for example, as slideshows. The data structure for managing reproduction of 
still pictures for a high-density recording medium in accordance with 
embodiments of the present invention will be described along with methods 
and apparatuses according to embodiments of the present invention for 
recording and reproducing still images. 

[0030] As will be appreciated from the above and following 

disclosure, still images may be displayed as a sequential slideshow, a 
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random/ shuffle slideshow, or a browsable slldeshow. A sequential slideshow 
involves the reproduction of still images having limited duration in the order 
set forth by the playlist. This reproduction of the still images may also occur in 
synchronized reproduction with audio data. A browsable slide show involves 
reproduction of still images having infinite duration in an order set forth by, 
for example, the playlist. Reproduction proceeds to a previous or subsequent 
still image based on user input. A random/shuffle slideshow is a form of 
sequential or browsable slideshow in which the order to reproduce the still 
images is randomized. 

[0031] Figs. 3 and 4 illustrate an embodiment of a data 

structure and method for managing still images of a high-density recording 
medium such as a BD-ROM. As shown in Fig. 3, the component data streams 
of the still picture stream and the related data streams (e.g., the graphic & 
subtitle streams) are packetized into PES packets on a still image basis. 
Namely, each PES packet of the still picture stream includes a single still 
picture, and the associated PES packets of the related data include the related 
data associated with the still picture (e.g., for reproduction in synchronization 
with the associated still picture). The still picture together with related data to 
be reproduced in synchronization therewith are grouped into a still picture 
unit. On a still picture unit basis, the still picture stream and related data 
streams are multiplexed into a still picture file of MPEG2 transport streams. 

[0032] Fig. 3 further shows a clip information file corresponding 

to the still picture file. The clip information file includes an entry point map 



9 



Attorney Docket No. 1 740-000085 /US 



(EP_MAP). Individual entry points (EP #1 ~ #k) in the EP map contain 
respective navigation information for accessing a head recording position of a 
corresponding still picture unit. The navigation information, for example, 
includes source packet number entry point start (SPN_EP_Start) information 
indicating the start recording position of the corresponding still picture unit. 

[0033] Fig. 4 illustrates a playlist for play control of the still 

picture file discussed above with respect to Fig. 3. As shown, a playitem 
(Playltem) in the playlist contains in-picture (IN_picture) information and 
out-picture (OUT_picture) information corresponding respectively to the start 
position and end position of the still images in the still picture file to 
reproduce. A sub-playitem (SubPlayltem) in the playlist contains 
sub-playitem in-time (SubPlayItem_IN_time) information and sub-playitem 
out-time (SubPlayItem_OUT_time) information for a separate audio file to be 
reproduced in association with the still picture file. The audio data may be 
reproduced in either a synchronized or unsychronized fashion with the 
associated still images. 

[0034] The playlist further includes a playlist mark, referred to 

hereinafter as still mark, pointing to each still picture. The presentation 
duration information for the still picture and related data included in a still 
picture unit may be recorded in the still mark corresponding to the still 
picture unit. Alternatively or additionally, the presentation duration 
information may be contained in the playitem. 

[0035] The still marks are particularly useful when skipping 
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between pictures during a browsable slideshow. It will further be appreciated 
that the still picture file or portions thereof can be simultaneously associated 
with a number of playlists with presentation durations different from each 
other. 

[0036] Presentation time stamps (PTSs) are recorded in each 

PES packet and/or each entry point. A PTS has a value in proportion to, for 
example, the well-known program clock reference (PCR) value; and therefore, 
as described below, will have a value proportional to a time base defined by 
PCRs referred to as STC (e.g., a system time based on of PCRs). As is 
well-known, the PCR is a time stamp added to packets in an MPEG2 transport 
stream according to the MPEG2 standard. When a still picture has an infinite 
presentation duration, the STC (e.g., PCR count) maintains the same value 
and a PTS proportional thereto is recorded in the PES packet of the 
corresponding still picture. Accordingly, an identical PTS is recorded to both 
the PES packet of a still picture with infinite presentation duration and the 
PES packet of the preceding still picture. For example, a reproducing 
apparatus may calculate the difference between the PTSs recorded in 
subsequent entry points or subsequent still picture PESs to determine 
presentation duration for the second of the two consecutive still pictures. 
When the difference between the PTSs is zero, the reproducing apparatus 
reproduces the corresponding still picture with infinite presentation duration 
- meaning that the still picture is reproduced until user input providing 
instructions to the contrary is received. Otherwise, the reproducing apparatus 
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reproduces the still picture for the calculated duration. 

[00371 In other words, the reproducing apparatus, at the time of, 

for example, reproducing slideshows of still pictures, decides whether the 
presentation duration for each still picture is infinite or finite. When the 
presentation duration corresponds to infinite, the reproducing apparatus 
does not increase the STC but maintains the previous value. On the contrary, 
when the presentation duration is finite, the reproducing apparatus conducts 
a series of operations to normally increase the STC. 

[0038] Fig. 5 illustrates a schematic diagram of a partial 

structure of an optical disc reproducing apparatus according to an 
embodiment of the present invention. As shown, the optical disc reproducing 
apparatus includes an optical pickup 111 for reproducing data from the an 
optical disk. A VDP (Video Disc Play) system 112 controls the reproduction 
operation of the optical pickup 111 and demodulates the data reproduced by 
the optical pickup 111. The VDP 112 produces an AV stream, which may also 
be fed to a D/A converter 1 13 to generate an analog version of the AV stream. 

[0039] The VDP system 112 controls the optical pickup 111 and 

demodulates the reproduced data based on user input received from a user 
interface and the navigation and management information recorded on the 
optical disk in accordance with the present invention. For example, the VDP 
system 112 makes reference to still marks included in a playlist and an entry 
point map included in a clip information file as described above to reproduce a 
still picture file. Namely, the VDP system 112 reads out a still picture, graphic 
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data, and subtitle data of each still picture unit according to the order of entry 
points (EP #1, #2, ...) recorded in the entry point map. Then, the VDP system 
112 conducts a series of operations for reproducing still pictures, which may 
be (i) reproduced for a fixed time duration according to the presentation 
duration information included in the still marks or determined form the PTSs, 
or (ii) reproduced in the form of skipped reproduction in units of the still 
picture unit, for example, corresponding to each of the still marks, according 
to the key input of the user. 

[0040] As shown in Fig. 6, the VDP system 112 may comprise a 

switch 120, a track buffer 121, a TS demultiplexer 122, a video buffer 123, a 
graphic buffer 124, a subtitle buffer 125, an audio buffer 126, a video decoder 
127, a graphic decoder 128, a subtitle decoder 129, an audio decoder 130, a 
microcomputer 131, a first STC generator 140 and a second STC generator 
141. 

[0041] The microcomputer 131 controls the operation of the 

switch 120 according to the key input of a user or presentation duration 
information, thereby selectively feeding a still picture (V), graphic data (G), 
and subtitle data (ST) into the track buffer 121. The TS demultiplexer 122 
makes reference to the packet ID (PID) of the data stream temporarily stored 
in the track buffer 121 and distributes still picture data, graphic data, and 
subtitle data into the video buffer 123, the graphic buffer 124, and the subtitle 
buffer 125, respectively. 

[0042] The video decoder 127 decodes the still picture data, the 
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graphic decoder 128 decodes the graphic data, and the subtitle decoder 129 
decodes the subtitle data. As a result, a single still picture and related graphic 
and subtitle data are reproduced, for example, in synchronization. 

[0043] Similarly, the microcomputer 131 controls the operation 

of the switch 120 and selectively feeds audio data (A) read out from an optical 
disc into the track buffer 121. The TS demultiplexer 122 makes reference to 
the packet ID (PID) of the audio data stream temporarily stored in the track 
buffer 121, thereby separating the audio data into the audio buffer 126. 

[0044] The TS demultiplexer 122 separates each audio 

presentation time stamp (A_PTS) from the reproduced audio data stream and 
sends the A_PTSs to the audio decoder 130. The TS demultiplexer 122 also 
separates audio program clock references (A_PCRs) from the reproduced 
audio data stream and sends the A_PCRs to the first STC generator 140, 
which counts the A_PCR to generate an audio STC. Then, the audio STC 
(A_STC) is sent to the audio decoder 130. The audio decoder 130 compares the 
A_PTS with the A_STC and outputs decoded audio when they are of the same 
value. 

[0045] In a similar manner, the TS demultiplexer 122 separates 

each still picture presentation time stamp (S_PTS) from the reproduced still 
picture data stream and sends the S_PTSs to an MPEG decoder 170 formed 
by the video decoder 127, the graphic decoder 128, and the subtitle decoder 
129. The TS demultiplexer 122 also separates still picture data program clock 
references (S_PCRs) from the reproduced still picture data stream and sends 
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the S_PCRs to the second STC generator 141, which counts the S_PCRs to 
generate an still picture STC. Then, the still STC (S_STC) is sent to the MPEG 
decoder 170. 

[0046] The MPEG decoder 170 keeps comparing the S_PTS with 

the S_STC and outputs a still image when they are of the same value. If the 
presentation duration of the still image is limitless, the microcomputer 131 
controls the second STC generator 141 to stop its counting operation. 

[0047] If another still picture is to be displayed according to user 

key input, the microcomputer 131 loads the PCR obtained from the still 
picture to be displayed into the second STC generator 141 and resumes the 
PCR counting operation. 

[0048] As a result, the optical disk reproducing apparatus may 

reproduce still images recorded on the optical disk using the MPEG decoder 
170 for reproducing movie data by utilizing the first and second STC 
generators 140 and 141 and perform browsable slideshow operations for the 
still images responsive to user key input. With respect to the browsable 
slideshows, for example, the audio data and still picture data (or still and 
related picture data) may be reproduced independently because of the 
separate and independent STC control provided by the first and second STC 
generators 140 and 141. Namely, if a user changes the still picture being 
displayed as described above, this does not affect the decoding of the audio 
data. 

[0049] In the VDP system 112, a STC adder 151 may be 
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employed instead of the second STC generator 141 such as shown in FIG. 7. 
When presenting a still picture having a limitless presentation duration, the 
microcomputer 131 controls the STC adder 151 in such a way that the S_STC 
generated thereby is not applied to the MPEG decoder 170. 

[0050] If a different still picture is to be displayed, the 

microcomputer 131 calculates the difference between a PCR obtained from 
the still picture to be displayed and the A_STC reproduced by the first STC 
generator 140, and outputs the difference to the STC adder 151 as a PCR 
offset. 

[0051] The STC adder 151 adds the AJ3TC from the STC 

generator 140 and the PCR offset from the microcomputer 131, and outputs 
the sum as the S_STC to the MPEG decoder 170. As a result, the optical disk 
reproducing apparatus may reproduce still images recorded on the optical 
disk using the MPEG decoder 170 for reproducing movie data by utilizing the 
S_STC and output from the STC adder 151 and may perform browsable 
slideshow operations for the still images responsive to user key input. 

[0052] Fig. 8 illustrates a schematic diagram of an embodiment 

of an optical disk recording and reproducing apparatus according to the 
present invention. As shown, an AV encoder 9 receives and encodes data (e.g., 
still image data, audio data, etc.). The AV encoder 9 outputs the encoded data 
along with coding information and stream attribute information. A 
multiplexer 8 multiplexes the encoded data based on the coding information 
and stream attribute information to create, for example, an MPEG-2 transport 
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stream. A source packetizer 7 packetizes the transport packets from the 
multiplexer 8 into source packets in accordance with the audio/video format 
of the optical disk. As shown in Fig. 8, the operations of the AV encoder 9, the 
multiplexer 8 and the source packetizer 7 are controlled by a controller 10. 
The controller 10 receives user input on the recording operation, and provides 
control information to AV encoder 9, multiplexer 8 and the source packetizer 
7. For example, the controller 10 instructs the AV encoder 9 on the type of 
encoding to perform, instructs the multiplexer 8 on the transport stream to 
create, and instructs the source packetizer 7 on the source packet format. The 
controller 10 further controls a drive 3 to record the output from the source 
packetizer 7 on the optical disk. 

[0053] The controller 10 also creates the navigation and 

management information for managing reproduction of the data being 
recorded on the optical disk. For example, based on information received via 
the user interface (e.g., instruction set saved on disk, provided over an 
intranet or internet by a computer system, etc.) the controller 10 controls the 
drive 3 to record one or more of the data structures of Figs. 1-4 on the optical 
disk. 

[0054] During reproduction, the controller 10 controls the drive 

3 to reproduce this data structure. Based on the information contained 
therein, as well as user input received over the user interface (e.g., control 
buttons on the recording and reproducing apparatus or a remote associated 
with the apparatus), the controller 10 controls the drive 3 to reproduce the 
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data from the optical disk. For example, as discussed above with respect to 
the embodiments of the present invention, a still image or still images may be 
reproduced in association with audio data based on the navigation 
information. Furthermore, an image or group of images may be reproduced as 
a slideshow or portion of a slideshow. As also discussed, a slideshow may be 
synchronized, browsable, etc. 

[00551 The reproduced source packets are received by a source 

depacketizer 4 and converted into a data stream (e.g., an MPEG-2 transport 
packet stream). A demultiplexer 5 demultiplexes the data stream into encoded 
data. An AV decoder 6 decodes the encoded data to produce the original data 
that was feed to the AV encoder 9. During reproduction, the controller 10 
controls the operation of the source depacketizer 4, demultiplexer 5 and AV 
decoder 6. The controller 10 receives user input on the reproducing operation, 
and provides control information to AV decoder 6, demultiplexer 5 and the 
source packetizer 4. For example, the controller 10 instructs the AV decoder 9 
on the type of decoding to perform, instructs the demultiplexer 5 on the 
transport stream to demultiplex, and instructs the source depacketizer 4 on 
the source packet format. 

[0056] While Fig. 8 has been described as a recording and 

reproducing apparatus, it will be understood that only a recording or only a 
reproducing apparatus may be provided using those portions of Fig. 8 
providing the recording or reproducing function. 

[00571 As will be appreciated from the forgoing disclosure, the 
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present invention provides a recording medium having a data structure for 
managing still images and audio data recorded on a high-density recording 
medium (e.g., a high-density optical disk such as a BD-ROM). For example, 
the data structure allows for displaying still images and audio data in 
various ways. 

[0058] The method of managing still images for a high-density 

recording medium in accordance with the invention provides various still 
control operations and allows effective linked reproduction of still images 
along with associated subtitle data or graphic images. 

[0059] As apparent from the above description, the present 

invention provides methods and apparatuses for recording a data structure 
on a high density recording medium for managing still images and audio data 
recorded on the recording medium. 

[0060] The above description further provides methods and 

apparatuses for reproducing still image and audio data recorded on a high 
density recording medium. 

[0061] While the invention has been disclosed with respect to a 

limited number of embodiments, those skilled in the art, having the benefit of 
this disclosure, will appreciate numerous modifications and variations there 
from. For example, while described with respect to a Blu-ray ROM optical disk 
in several instances, the present invention is not limited to this standard of 
optical disk or to optical disks. It is intended that all such modifications and 
variations fall within the spirit and scope of the invention. 
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